🏗️ AI Infrastructure - nmarshall · Scour

A developer’s guide to architecting reliable GPU infrastructure at scale ⚡Hardware Acceleration

cloud.google.com·5d

Building a Robust Documentation Agent with DigitalOcean Gradient AI Platform 🤖AI Coding Tools

digitalocean.com·1d·Hacker News

Multi-agent AI orchestration built for governance, in Rust 🤖AI agents

broodlink.ai·13h·Hacker News

Aethon: A Reference-Based Replication Primitive for Constant-Time Instantiation of Stateful AI Agents ⚙️Concurrency Models

arxiv.org·1h·Hacker News

amitshekhariitbhu/llm-internals: Learn LLM internals step by step - from tokenization to attention to inference optimization. 💻Local LLMs

github.com·1d·Hacker News

The hyperscalers are pricing themselves out of AI workloads 🔩Bare Metal

infoworld.com·19h

Semidynamics Secures SK hynix Investment to Advance Memory-Centric AI Inference Architecture ⚡Hardware Acceleration

hpcwire.com·4d·Hacker News

Closing the AI Open-Source Gap 🤖AI Coding Tools

newsletter.ownersnotrenters.com·1d·Hacker News

Advanced AI Platform for Content Generation 🤖AI Coding Tools

uni-1.co·5d·Hacker News

EU's Exposed AI Infrastructure 🏠Self-hosted AI

insecurestack.substack.com·6d·Substack

Fast Isn’t Fast Enough: Redefining Metrics for Edge AI 📱Edge AI

semiengineering.com·5d

Optimizing our inference back end with custom load balancing 🧩Nomad

photoroom.com·6d·Hacker News

milanm/AutoGrad-Engine: A complete GPT language model (training and inference) in ~600 lines of pure C#, zero dependencies 🤖Transformers

github.com·5d·Hacker News

Producing The Perfect Token 🔁Cache Coherence

blog.luminal.com·3d·Hacker News

Unlocking cloud inference compute for OpenClaw 🏠Self-hosted AI

news.ycombinator.com·6d·Hacker News

Contemplating Meta’s Homegrown MTIA Compute Engine Roadmap ⚡Hardware Acceleration

nextplatform.com·6d·Hacker News

Scaling Managed Agents: Decoupling the brain from the hands 🤖Anthropic Claude

anthropic.com·6d·Hacker News, Hacker News, Hacker News

PyTorch Foundation Expands AI Stack with Safetensors, ExecuTorch, and Helion 🔥Burn

thenewstack.io·5d·Hacker News

Behind the Analysis with Google Cloud and Team USA: Architecting AI infrastructure for U.S. Winter Olympians 📱Edge AI

cloud.google.com·4d

AsyncTLS: Efficient Generative LLM Inference with Asynchronous Two-level Sparse Attention 💻Local LLMs

arxiv.org·5d

No more posts from nmarshall's subscribed feeds.

Scour all 23985 feeds Learn more about Feeds